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(57) An electronic camera and system for capturing 
of digital images, and wireless transmission of the cap- 
tured images to a recipient. The camera includes a se- 
lection device for creating an electronic content identifier 
to be associated with a digital image file in the camera 
that identifies a recipient that the associated digital im- 
age file is to be forwarded. 
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Description 

[0001] The present invention is directed to automati- 
cally managing digital image files over a communication 
network. 5 
[0002] Currently, there are many providers of online 
imaging services. One such example is the Kodak Ph- 
otoNet Online service offered by the Eastman Kodak 
Company. In such a system, a user must select a pho- 
tofinishing order option on the film processing envelope 10 
that includes the digitization and uploading of the high 
resolution film images to a secure website where they 
are stored. Upon receiving and paying for the printed 
photofinishing order, the user receives a coupon that in- 
cludes information for accessing the digital images on 15 
the website. Subsequently, the user must return to their 
home and using a computer with aconventional Internet 
browser must navigate to the website indicated by the 
coupon . Upon arrival at the website and entry of the sup- 
plied information, the user finally is able to view their 20 
digital images. 

[0003] At this point, the user can electronically share 
their images with third parties. Depending on the skill of 
the user, they can choose to send digitized images as 
image file attachments via electronic mail. This entails 25 
knowing the electronic address of those third parties 
which is usually stored and managed by a different soft- 
ware application on the user's computer. Furthermore, 
image file attachments can cause an electronic mailbox 
to exceed a predetermined storage capacity especially 30 
if the user desires to share several images. 
[0004] Another method of electronically sharing that 
attempts to solve the dilemma of sharing several images 
involves, sending an electronic link embedded in an 
electronicmail message that when clicked by the receiv- 35 
er, causes the receiving computer to locate and access 
the website containing the entire digitized order. A prob- 
lem with this method is that the receiver must have an 
Internet browser that is compatible with the electronic 
mail application to automatically launch the internet 40 
browser to the site of the digitized images. Furthermore, 
the receiver must enter information to view the images 
at the site. Access must also be given for each and every 
film order processed and uploaded. 

[0005] If the user desires to retrieve a copy of the dig- 45 
itized image for use on their own computer, they can en- 
counter additional problems. For example, the user 
must follow several time consuming steps that often in- 
cur an additional charge or fee beyond the initial pho- 
tofinishing order fee, to retrieve the high resolution im- 50 
age file that is stored at the online photoservice provider. 
In other cases some photoservice providers do not allow 
the user to download the high resolution image file at all. 
[0006] Another common service provided by online 
photoservice providers is the ability for a user to use a 55 
computer to upload a digitized image already in the pos- 
session of the user such as image files created by a 
scanner, a digital camera, or a digitized film product 
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such as the PictureCD™ produced by the Eastman Ko- 
dak Company. These online photoservice providers 
store high resolution image files uploaded by users typ- 
ically for producing printed images. Electronically shar- 
ing of these images is similar to those being placed at 
a website automatically by a photofinisher and similar 
problems are encountered by a user using such a serv- 
ice. The user must, for example, take the time to upload 
each and every image that he or she wishes to print or 
electronically share. 

[0007] Another disadvantage with prior art systems is 
that the owner of the image often loses control of the 
high resolution image as this is typically stored at the 
service provider. Additionally, it is also undesirable to 
keep an entire copy of the high resolution images at a 
service provider as charges are often associated with 
such storage. In addition if the service provider loses the 
image it can be very difficult to regain the original high 
resolution image. It is therefore desirable to be able to 
restore the high resolution images at the user computer. 
[0008] In situations where the high resolution images 
are stored on user computer memory storage devices, 
such as a hard drive, there exists the possibility of a 
memory failure with respect to the stored images. Thus, 
there is also a need to be able to provide a system to 
assist in reestablishing the high resolution images at the 
user computer with little or no cost to the user in the 
event of a failure of a user memory storage device. 
[0009] In accordance with one aspect of the present 
invention there is provided an electronic camera for cap- 
turing of digital images, the camera comprising: 

a communication device for wireless transmission 
of digital image files captured by the electronic cam- 
era to a recipient: 

a selection device for creating an electronic 
content identifier to be associated with a digital 
image file in the camera, the camera having a 
cell modem for sending images up to a service 
provider, the content identifier identifying a re- 
cipient that the associated digital image file is 
to be forwarded. 

[0010] In accordance with another aspect of the 
present invention there is provided an electronic camera 
for capturing of digital images, the camera comprising: 

a communication device for wireless transmission 
of digital image files captured by the electronic cam- 
era to a recipient: 

a computer software program for analyzing the 
digital image files for recognizing a pre-select- 
ed image content, upon recognizing the image 
content an electronic instruction is created with 
respect to further processing of the digital im- 
age by the recipient which is transmitted to the 
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recipient along with digital image file. 

[0011] In accordance with yet another aspect of the 
present invention there is provided a system for trans- 
mitting digital image files captured by an electronic cam- 
era for capturing of digital images , the camera having 
a communication device for wireless transmission of 
digital image files captured by the electronic camera to 
a recipient; 

the recipient having a computer software program 
for analyzing the digital image files for recognizing a pre- 
selected image content, upon recognizing the image 
content an electronic instruction is created with respect 
to further processing of the digital image by the recipient. 
[0012] In accordance with still another aspect of the 
present invention there is provided a method for man- 
aging image transmitted directly from an electronic cam- 
era to recipient, the electronic camera having a device 
for wireless transmission of a digital media file to the 
recipient, comprising the steps of: 

receiving a digital media file over a wireless trans- 
mission from the electronic camera, the digital me- 
dial file having a digital image file and an instruction 
with respect to the digital image file; 
implementing the instructions provided in the digital 
media file. 

[0013] These and other aspects, objects, features 
and advantages of the present invention will be more 
clearly understood and appreciated from a review of the 
following detailed description of the preferred embodi- 
ments and appended claims and by reference to the ac- 
companying drawings. 

[0014] In the detailed description of the preferred em- 
bodiments of the invention presented below, reference 
is made to the accompanying drawings in which: 

FIG. 1 is a schematic diagram of a system made in 
accordance with the present invention showing the 
relationship of a user desiring to share digital imag- 
es with a third party as permitted by a service pro- 
vider; 

FIG. 2 is a flow chart which shows the steps in cre- 
ating a user account and image storage file in ac- 
cordance with the invention; 
. . FIG. 3 is a flow chart which shows the steps in au- 
tomatically sharing digital images with an author- 
ized third party in accordance with the invention; 
FIG. 4 is a schematic diagram showing the relation- 
ship of a film processing photofinisher desiring to 
download digitized film images with a user as per- 
mitted by a service provider; 
FIG. 5 is a modified system made in accordance 
with the present invention showing the relationship 
of a user desiring to share digital images with a third 
party as permitted by a service provider; 
FIG. 6 is a flow chart which shows the steps of the 



method of operation of the system of FIG. 5; 
FIG. 7 is a flow chart which shows the steps of an- 
other method of operation of the system of FIG. 5; 
FIG. 8 is a flow chart which shows another method 
5 of sharing images using the system of FIG. 1 or FIG. 

5; 

FIG. 9 is a flow chart which shows yet anothermeth- 
od of sharing images using the system of FIG. 1 or 
FIG. 5; 

FIG. 1 0a is partial view of a display screen illustrat- 
ing an image from which an image content identifier 
is obtained; 

FIG. 10b is an enlarged view of the image content 
identifier of FIG. 10a; 

FIG. 11 is a flow chart of still another method of op- 
eration of the system of FIG. 5: 
FIG. 12 is a flow chart which illustrates the process 
of tracking an individual low resolution image file 
used to produce goods and/or services; 
FIG. 1 3 is a chart illustrating an example of one way 
revenues can be distributed among various parties; 
FIG. 14. is a flow chart of a method for restoring a 
high resolution image on a user device; 
FIG. 1 5 is another modified system made in accord- 
ance with the present invention showing the rela- 
tionship of a user desiring to share digital images 
with a third party as permitted by a service provider; 
FIG. 16 is a flow chart illustrating another method 
of operation of the systems of FIGS. 1 , 5 and 15; 
FIG. 1 7 is a screen shot of a display screen showing 
an image and an electronic instruction/order form. 
FIG. 18 is a flow chart illustrating another method 
of operation of the systems of FIGS. 1 , 5 and 15; 
FIG. 19 is a block diagram of an electronic camera 
23; 

FIG. 20 depicts a rear view of the electronic camera 
incorporating the features of FIG. 19; 
FIG. 21 is a flow chart of a method of using the elec- 
tronic camera of FIG 20; 

FIG. 22 shows a flow chart that illustrates another 
method of operation of the system of FIG. 1 ; and 
FIG. 23 illustrates a flow chart which shows another 
method of operation of the system of FIG. 1 

[0015] Referring to FIG. 1 , there is illustrated a system 
1 8 made in accordance with the present invention. Sys- 
tem 18 includes a user computer 10 operably connected 
through a communication service provider (CSP) 20 and 
a communication network 50 (such as the Internet) to a 
service provider 80. Also included in system 18 is a third 
party computer 1 6 operably connected to the communi- 
cation network 50 and service provider 80 via a CSP 22. 
User computer 1 0 is also operably connected to an elec- 
tronic camera 12 and a storage drive 14. The electronic 
camera 12 can be a digital still camera such as the Ko- 
dak DC280 digital camera manufactured by the East- 
man Kodak Company or it can be a digital motion cam- 
era such as the Kodak MC3 portable multimedia device 
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which records motion and sound in addition to still cap- 
ture and sound reproduction. For the simplification of 
discussion, digital images originally created by either 
digital still, digital motion electronic cameras, or by scan- 
ning film, will be referred to as high resolution image 
files. Likewise, low resolution files are formed from the 
high resolution imagefiles by sub-sampling, which in the 
case of digital still image files, involves reducing the 
number of image pixels and effectively lowering the res- 
olution. Such low-resolution, or "thumbnail" size imag- 
es, can be created as described in commonly-assigned 
US patent 5,164,831 "ELECTRONIC STILL CAMERA 
PROVIDING MULTI-FORMAT STORAGE OF FULL 
AND REDUCED RESOLUTION IMAGES" to Kuchta, et. 
al., the disclosure of which is herein incorporated by ref- 
erence. In the case of digital motion files, low resolution 
files can include the discarding of frames and/or pixels 
within a frame. Such techniques are well known in the 
art and facilitate the transportation of images across any 
communication network 50 such as the Internet 
[0016] In the particular embodiment illustrated, the 
storage drive 14 is illustrated as being removable. How- 
ever the present invention is not limited to such a con- 
figuration. For example, the storage drive 1 4 can be an 
integral part of user computer 1 0 and can use removable 
storage media (not shown). The electronic camera 12 
can connect to the user computer 10 via a cable em- 
ploying a common interface such as a Universal Serial 
Bus (USB) interface. Alternatively, electronic camera 1 2 
can connect to the user computer 10 in a wireless mode 
employing any number of conventional interfaces such 
as the radio frequency standard commonly described 
by Bluetooth™ Specification V1 .0 or Wireless Personal 
Area Network IEEE Standard 802.15. Likewise, remov- 
able storage drive 14 is operably connected to user 
computer 1 0 and permits the storage of high resolution 
image files such as digital still or digital motion images 
and associated metadata that can, for example, further 
include audio information. For the purposes of the 
present invention, an image media file includes a digital 
image file (high or low resolution) and can also include 
additional data such as associated audio or metadata. 
The user selects the location for the storage of the high 
resolution image media files either internally to the user 
computer 10 or on removable storage drive 14, such as 
computer disc, CD, etc.. In general, high resolution im- 
age media files can be arranged in a user storage file 
such as a database. 

[0017] The user computer 10 is provided with appro- 
priate software for allowing controlled access to a high 
resolution image media collection, such as a database, 
stored on memory storage device 14. The high resolu- 
tion image media collection comprises at least one high 
resolution image media file and as previously discussed 
can include associated digital data. A low resolution 
copy of each high resolution digital image file along with 
any associated meta data/information (the combination 
of both files hereinafter referred to as the user low res- 



olution image collection) is electronically sent to the 
service provider 80 for storage at the service provider 
80 and is associated with the user. One way in which an 
image can be associated with a user is the addition of 

5 metadata to the image media f iles(s) that reflects a spe- 
cific user identifier such as a user account number, a 
user provided identifier with any combination of alpha- 
numeric characters, or any other construct in the form 
of metadata. Another form of association with the user 

10 can be accomplished by creating a storage system that 
allocates file storage based on a user identifier such as 
a relational database. This association creates a low 
resolution user image collection of the digital imagefiles 
at the service provider 80. While the digital image files 

15 and associated data files can be forwarded by the user, 
these files can be automatically retrieved by the service 
provider 80. For example, the user has a database iden- 
tified for access by the service provider 80. The service 
provider 80 can automatically, on a routine schedule, 

20 determine if the user computer 1 0 is available over the 
communication network 50. If the user computer 10 is 
available for communication, the service provider 80 will 
then automatically review the database on the user 
computer 10 where the high resolution media files are 

25 stored to determine if any new digital image files or as- 
sociated files have been added to the database. If new 
files have been added or changed, then a low resolution 
image file is formed for each new image and data chang- 
es are appropriately communicated to the service pro- 

30 vider 80 for storage and association with the user low 
resolution image collection. 

[0018] As previously discussed, in addition to the low 
resolution images stored at the service provider 80, 
there can be stored various other data/information re- 

35 lated to these images. This information can be used to 
identify who can have access to the low resolution im- 
age and information that describes the content of the 
images. In addition, this information can include infor- 
mation relating to the data storage structure of the high 

40 resolution images stored on image storage device 14. 
The data storage structure information includes param- 
eters that reflect the storage locations of the high reso- 
lution image media files on the physical media such as 
track and sector information associated with hard disk 

^5 memory architecture. This information can be used to 
assist in the rebuilding of a damaged directory in the 
event of a failure of storage device 14 and can be auto- 
matically updated on a routine communication interval 
by the service provider 80. Oftentimes, damaged direc- 

50 tories on hard disks can render a disk drive unreadable 
when the actual file data is still valid. Software running 
on the user computer 1 0 such as the commercially avail- 
able Norton Utilities offered by Symantec Inc. can re- 
store the accessibility of high resolution image media 

55 files using the data storage structure information related 
to the low resolution image media files stored by service 
provider 80 as later discussed herein with respect to 
FIG. 14. Service provider 80 can provide this additional 
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service for a fixed or recurring fee. This can provide val- 
uable assistance in reconstructing damaged digital im- 
age files on user computer 10. 

[0019] Further information can be provided to the 
service provider 80 for assisting in identifying content of 
the images and/or individuals that can have access to 
the images. For example, an image icon 202, such as 
illustrated in FIG. 1 0b can be used as a content identifier 
to first identify content of images forwarded to the serv- 
ice provider 80. In the embodiment illustrated, the image 
icon 202 is in the form of the face of an individual taken 
from image 206 of FIG. 1 0a. Thus face recognition soft- 
ware programs, such as described in co-pending EPO 
patent application Serial No. 01 202975.7 filed August 6, 
2001 to John R. Squilla and Dale Fredrick Mclntyre 
which is hereby incorporated in its entirety by reference, 
can be used to review the images to be forwarded and 
identify the images with such content identifiers. When 
such images are identified, the identification information 
is recorded as metadata and stored in association with 
that image. The identification information can be used 
to identify who can view this image at the service pro- 
vider 80 or even provide an automatic forwarding of the 
image to a specified individual. While the images can 
be automatically analyzed for such information, the user 
can also specify that a particular icon 202 be associated 
with a particular image. 

[0020] While the icon 202 has been shown for use in 
identifying other individuals found within digital images 
to which said images are to be forwarded, the present 
invention is not so limited. The icon 202 can also be used 
to identify images that the user wishes to be sent to him. 
For example, the icon 202 can represent the face of the 
user and that when the icon 202 is sent to a third party 
it can be used to identify images that include the user. 
The icon 202 can also be provided with information, 
such as a Universal Resource Locator (URL) address, 
where the image is to be sent. The icon 202 can be sent 
to specific third parties wherein the third party would pro- 
vide consent to have their images reviewed for forward- 
ing to the user who provides the icon 202. The service 
provider 80, upon request from the user providing the 
icon 202, can search the low resolution image collec- 
tions of other users for occurrences of the icon 202 ap- 
plied to their images. Upon finding images of other users 
that have applied the icon 202 of the user providing the 
icon 202, service provider 80 can automatically forward 
these images to the user providing the icon 202. Fur- 
thermore, service provider 80 keeps a log or record of 
the other users who have used the icon 202 provided 
by the user. Thus the service provider can monitor ac- 
cess and/or use of digital media files associated with the 
icon 202. When the user updates their icon 202, for ex- 
ample, when their appearance changes due to aging, 
modifications to hair style or color, modifications to facial 
hair etc., service provider 80 automatically updates the 
icon 202 for those users found in the log associated with 
the use of the specific updated icon 202. The updated 



icon 202 can replace the existing icon 202 or it can be 
simply added to the database of icons 202. Allowing the 
two icons 202 to coexist permits the recognition of high 
resolution image files that can be scanned and provided 

5 at a substantially later date. The icon 202 can also be 
used to access public sites that have images that can 
be used freely or for a price. While the icon 202 has been 
described as recognizing images containing a particular 
individual, the icon 202 can represent any theme, for ex- 

10 ample, any sports, hobby, or item. Images that have 
been identified with any such theme can be automati- 
cally forwarded by service provider 80 to the image col- 
lection of a special interest group that a user may belong 
to. Such preferences for forwarding are stored at service 

15 provider 80 as previously discussed. 

[0021] Further information such as loyalty points can 
be associated with the user by the service provider 80 
in response to interactions with the system 1 8 or the sys- 
tem 200 (FIG. 5). For the purpose of the present inven- 

20 tion, loyalty points shall be considered discounts, credits 
or other value assessed on behalf of the user which are 
credited toward the purchase or sale of goods and/or 
services. For example, a user who shares at least one 
of the low resolution image media files with an author- 

25 ized third party, can earn loyalty points from service pro- 
vider 80, if the authorized third party orders image based 
goods and/or services from service provider 80 that are 
derived from the shared low resolution image media 
files. Service provider 80 can award more points to a 

30 user who shares with an authorized third party that 
doesnt currently have an existing relationship with serv- 
ice provider 80. Incentives, in this case, are placed on 
encouraging additional users to develop relationships 
with service provider 80. To award loyalty points, service 

35 provider 80 can maintain a log or record of all accesses 
to images maintained in a user's image collection. This 
arrangement has the added benefit of providing a track- 
ing mechanism in the event that an authorized third par- 
ty misuses an image file provided by a user. Loyalty 

40 points can be redeemed at service provider 80 or fulfill- 
ment provider 70 for image related goods and/or serv- 
ices. See FIG. 12 for a more complete description of this 
operation. 

[0022] Another process of earning loyalty points will 
45 be discussed later with respect to FIG. 18 and can in- 
clude authorized third parties performing extended serv- 
ices such as cataloging by matching the user's content 
identifiers to the user's digital images to be cataloged. 
Rewarding an authorized third party with loyalty points 
50 for matching the user's content identifiers to the user's 
images relieves service provider 80 from the image 
processing burden. 

[0023] Service provider 80 includes a server 82 for in- 
terfacing with the communications network 50 such as 
55 the Internet or a virtual private network (VPN). In addi- 
tion to interfacing to the communications network 50, 
server 82 transfers information to computer system 86 
which manages information associated with various us- 
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ers. Computer system 86 includes an account manager 
84 which is software operating in accordance with the 
invention to permit the creation and management of in- 
dividual user accounts. Information associated with user 
accounts is stored in relational database(s) 88. User ac- 
count information includes personal information such as 
name and address, billing information such as credit 
card information, network information such as personal 
electronic location information and authorization infor- 
mation which controls access to the user's images by 
third parties. Also associated with user accounts are re- 
lational database(s) 88 which store low resolution user 
image files, related metadata and other information rel- 
evant to providing services to the user. One such exam- 
ple, but not by way of limitation, is a defect and directory 
map of the user's physical storage device to aid in the 
recovery of damaged image media files stored on the 
storage device 14. 

[0024] Also shown in FIG. 1 is fulfillment provider 70 
which provides image-based goods and/or services to 
users and third parties. Fulfillment provider 70 includes 
a fulfillment web server 72, a digital printer 78 and a ful- 
fillment computer system 76 that further includes a com- 
merce manager 74 and a fulfillment manager 75. Fulfill- 
ment requests received from service provider 80, user 
computer 1 0 or third party computer 1 6 are handled by 
commerce manager 74 initially before handing the re- 
quests off to the fulfillment manager 75. The fulfillment 
manager 75 determines which equipment is used to ful- 
fill the ordered good(s) such as a digital printer 78. After 
fulfillment, the ordered goods are returned to the order- 
ing party by a delivery means for example, but not by 
way of limitation, a transportation vehicle 68. 
[0025] In order to better understand the present in- 
vention, a description of the operation of the system 18 
will be discussed. FIG. 2 is a flow chart of the operation 
of the system 1 8. In the first step 30, the user establishes 
an account with the service provider 80. As a part of es- 
tablishing an account, various information is provided, 
for example, but not limited to, name, address, electron- 
ic address, credit card information, names of individuals 
or business establishments that have permission to ac- 
cess image media files, names of any particular files of 
grouped images and authorized viewer, the type of ac- 
cess granted, name of a preferred fulfillment service 
provider for the providing of goods and/or services and 
automatic forwarding instructions per selected criteria. 
It is of course to be understood that any other relevant 
information and/or instructions can be provided as de- 
sired or that which the service provider is cable of pro- 
viding. In the next step 32, the user identifies or estab- 
lishes the high resolution media collection. In the next 
step 34, low resolution digital image files are formed 
from the high resolution digital image files in the collec- 
tion and are forwarded to the service provider 80 along 
with any appropriate associated data files (user low res- 
olution image collection) over the communication net- 
work 50. At the next step 36, the verification that the 



service provider 80 has received the low resolution me- 
dia files is completed. If the transfer of the low resolution 
media collection was not successful, the user is advised 
of this non-successful transmission in step 38 and re- 

5 peats the transmission of the low resolution media col- 
lection in step 34 until successful. Upon successful re- 
ceipt of the low resolution media collection, the service 
provider 80 at step 40 creates a low resolution media 
collection where these low resolution media collections 

10 are stored and associated with the user 

[0026] Referring to Fig. 3, there is illustrated a flow 
chart of one way in which the media files stored at the 
service provider 80 can be used. In step 40, the instruc- 
tions previously provided by the user are reviewed and 

is implemented. For example, if a third party has been des- 
ignated to automatically receive selected media files as 
identified, these media files will be forwarded over the 
communication network 50 to the designated third party 
at step 42. As illustrated by FIG. 1 , this can be a third 

20 party computer 16. Alternatively, the selected media 
files can be forwarded to a fulfillment provider 70 loca- 
tion for fulfillment of a service or product, such as pro- 
ducing a print for delivering to a designated individual 
from a fulfillment provider 70. While the fulfillment pro- 

25 vider 70 can use the low resolution media file for the 
fulfilling of the requested goods and/or services, often, 
the fulfillment provider 70 needs the high resolution dig- 
ital image. In such case, the provider 80 can directly ac- 
cess the high resolution files directly from the user or 

30 have them provided through the service provider 80. 
Typically the fulfillment provider 70 comprises a facility 
for printing or producing images from digital media files 
that have been provided by users and delivering them 
to designated locations. However, the fulfillment provid- 
es er 70 can deliver any goods or services that they are 
capable of providing. For example, but not by way of 
limitation, the goods can include T-shirts, mugs, cakes, 
or any other goods or services that incorporate images 
provided by the user. 

40 [0027] In anotherform of the present invention, at step 
44 a third party can access the low resolution image col- 
lection over the communication network 50 using third 
party computer 16. Optionally in Step 46, the service 
provider 80 can produce and transmit a report to the us- 

45 er that monitor the details of which media files were 
shared or accessed by which third parties. 
[0028] Turning now to FIG. 4, there is illustrated a flow 
chart representing a process used by service provider 
80 for automatically updating the low resolution image 

50 collection associated with a user during a regular and 
periodic update or replication procedure. At an agreed 
upon routine communication interval, service provider 
80 establishes a connection with user computer 1 0 (step 
52). The connection can either be established by the us- 

55 er computer 1 0 initiating communication or by the serv- 
ice provider 80 initiating the communication. The service 
provider 80 then checks to see if the high resolution im- 
age collection has been modified (step 54). Modifica- 
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tions to the high resolution image collection can include 
the addition or modification of at least one image media 
file, additions and/or modifications to metadata, modifi- 
cations to the user account information such as the ad- 
dition or deletion of authorized third parties, or any other s 
desired changes to the user account information. Once 
this information has been obtained, service provider 80 
makes the appropriate changes (step 56) to the user ac- 
count and/or low resolution image collection. Relational 
database(s) 88 are updated with the updated informa- 
tion. If no modifications to the high resolution image col- 
lection are detected (step 54), the service provider 80 
concludes the communication in step 58. 
[0029] Turning now to FIG. 5, there is illustrated a 
modified system 200 made in accordance with the 
present invention. System 200 is similar to system 18 
with like numerals indicating like parts and operation as 
previously discussed. In system 200, a photofinisher 90 
is provided for processing of photographic film 92. It 
should be noted that the photofinisher 90 can be a retail 
establishment by itself or operating in association with 
a wholesale photofinishing establishment. In the partic- 
ular embodiment illustrated, the photofinisher 90 in- 
cludes a film processor 94 for developing of the images 
on photographic film 92. A film scanner 96 is provided 
for scanning of images formed on the processed film for 
obtaining high resolution digital image files that are for- 
warded to a memory device 98 as high resolution image 
files. The photofinisher 90 also includes an appropriate 
computer 100 for managing of the various equipment 
and various operations of the photofinishing system. 
One such operation is the attachment of metadata to the 
high resolution image file that identifies the specific pho- 
tofinisher via a pre-assigned unique business identifier. 
In the case where the photofinisher 90 is a wholesale 
photofinisher operating in association with a retailer, 
separate business identifiers are attached as metadata 
to the high resolution image media files linking both 
wholesale photofinisher and retailer to the specific pho- 
tographic film 92 and the processed images associated 
therewith . Another operation of computer 1 00 is the pro- 
viding of information to a server 102 for communicating 
over the communication network 50 to various third par- 
ties. The photofinisher 90 also includes an appropriate 
printer 104 for printing of images that have been 
scanned onto an appropriate media, for example, pho- 
tographic paper, thermal media, etc. It is, of course, un- 
derstood that any other appropriate output device can 
be provided for producing prints or other products incor- 
porating images that have been obtained from the scan- 
ning of the developed photographic film 92. 
[0030] Referring to FIG. 6, there is illustrated a flow 
chart of one method of the operation of the system 200 
of FIG. 5. A roll of exposed, undeveloped photographic 
film 92 provided, for example, in a film cartridge 93 is 
forwarded to the photofinisher 90 (Step 106) in associ- 
ation with the user. In the next step 108, the photofin- 
isher 90 develops the film 92 and scans the developed 



images for producing high resolution image files that are 
temporarily stored on memory device 98 with metadata 
identifying the photofinisher 90 as the retailer or sepa- 
rably as the retailer and photofinisher as discussed ear- 
lier. The photofinisher 90, in the embodiment illustrated, 
further associates an unique identification (ID) 110 that 
is provided on the film 92 with the scanned images and 
hence, the high resolution image files. Such an unique 
ID 1 1 0 can also be attached to a user order in a variety 
of ways. For example, but not by way of limitation, the 
unique ID 110 can be associated with a photofinishing 
envelope (not shown), the film cartridge 93, pre-ex- 
posed on the film 92 itself, by random assignment, or 
any other appropriate way to associate the film 92 and 
the user. Unique ID 110 can be appended as metadata 
to the high resolution image media file upon scanning 
to associate the digital image with the user. Commer- 
cially available film products manufactured by the East- 
man Kodak Company under the Advantix™ brand are 
examples of film cartridges 93 having the unique ID 1 1 0 
associated with them. 

[0031] Continuing on with FIG. 6, these high resolu- 
tion media files and unique ID 110 are transferred via 
communication network 50 to the service provider 80 in 
association with the user at an appropriate time (step 
112). Following receipt of the high resolution media files, 
service provider 80 (step 114) checks to see if the 
unique ID 110 has been registered with specific 
processing instructions. A more complete description on 
one method of registering film with a service provider 
can be found in co-pending EPO. Patent Application Se- 
rial No. 00204407.1 filed December 11, 2000 to Dale 
Fredrick Mclntyre and Joseph Anthony Manico which is 
hereby incorporated in its entirety.. If the photographic 
film 92 is not registered, service provider 80 creates low 
resolution copies of each of the newly received high res- 
olution files in step 1 1 8. These low resolution copies are 
then added to the user's existing low resolution image 
collection in step 120. The high resolution files are tem- 
porarily stored at the service provider 80 until they are 
transferred to the user's high resolution image collection 
on the user computer 1 0 at the next routine communi- 
cation interval or non-scheduled communication (step 
122). In an alternate embodiment of steps 118, 120 
and122, service provider 80 can store the high resolu- 
tion image files for an ordering period that makes order- 
ing of image goods and/or services by the user or au- 
thorized third parties more convenient. The storing of 
the high resolution image files for the ordering period is 
in addition to transferring the high resolution files to the 
user computer 10. After the expiration of the ordering 
period, the high resolution image files are automatically 
converted to low resolution copies and added to the us- 
er's low resolution image collection. This would be par- 
ticularly useful to a service provider, in that, initial inter- 
est in obtaining prints or other image products/services 
usually occurs in a relatively short time after obtaining 
the image. Thus, making the need to obtain the high res- 
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olution file from user computer 10 unnecessary during 
this ordering period. 

[0032] If the photographic film 92 is registered, in- 
structions associated with the registration are carried 
out by the service provider 80 in step 1 1 6. These instruc- 5 
tions can include for example, but not by way of limita- 
tion, the directions to print, automatically transmit to var- 
ious third parties and deliver various image-based 
goods and/or services to the user or third parties desig- 
nated in the instructions. Third parties that have similar 10 
arrangements for low resolution image media collec- 
tions maintained by service provider 80 will receive the 
automatically transmitted low resolution image media 
files as additions to their low resolution image media col- 
lections. At the next routine communication interval for 15 
these third parties, these low resolution image media 
files are automatically transferred to the third parties' 
computers 16. Software running on each third party 
computer 16 causes newly transferred image media 
files to be presented to the third party without needing 20 
to use the process of attaching/detaching operations 
found in traditional electronic mail protocols. This proc- 
ess will be discussed in furtherdetail with respectto FIG. 
1 1 later in this specification. 

[0033] After completing the registered instructions, 25 
service provider 80 creates low resolution copies of 
each of the newly received high resolution image files 
in step 1 1 8. These low resolution copies are then added 
to the user's existing low resolution image collection in 
step 120. The high resolution image files are temporarily 30 
stored at the service provider 80 until they are trans- 
ferred to the user's high resolution image collection on 
the user computer 10 at the next routine communication 
interval. It is of course to be understood that any asso- 
ciated digital files can also be communicated to user 35 
computer 10. 

[0034] Another method of operating the system 200 
is shown as a flow chart in FIG. 7. In this embodiment, 
photographic film 92 associated with the user is forward- 
ed to the photofinisher 90 in step 1 24. The photofinisher 40 
90 in step 1 26 processes the photographic film 92, reads 
the unique ID 110, scans the developed film images, 
forms high resolution image files and temporarily stores 
them in memory device 98 associated with the user and 
the photofinisher 90 as discussed earlier. In step 128, 45 
photofinisher 90 establishes a communication connec- 
tion via communication network 50 to service provider 
80 and passes the unique ID 1 1 0 to service provider 80 
to see if the photographic film 92 has been registered 
and has instructions pertaining to the ordering of image 50 
related goods and/or services. If the photographic film 
92 had been registered, photofinisher 90 carries out the 
instructions (step 130) which can by way of example, 
but not limitation, include printing additional copies of 
the high resolution image media files to be forwarded to 55 
a third party via delivery vehicle 68. 
[0035] If the photofinisher 90 has been determined to 
be an authorized third party in step 132, the photofinish- 



er 90 can transfer (step 134) the high resolution image 
files from the memory device 98 to the user computer 
10. The updated high resolution media image collection 
on user computer 1 0 will be detected and the appropri- 
ate low resolution image files formed and transferred to 
the low resolution image media collection maintained by 
service provider 80 at the next routine communication 
interval. At this point, the photofinisher 90 reaches the 
conclusion of the activity in step 136. 
[0036] If the photofinisher 90 is not an authorized third 
party (step 1 32), photofinisher 90 transfers the high res- 
olution digital image files to the service provider 80 (step 
138). The service provider 80 then creates low resolu- 
tion image file copies of each high resolution digital im- 
age file (step 140), adds them to the low resolution im- 
age media collection associated with the user (step 1 42) 
and transfers the high resolution digital image files to 
the user computer 10 (step 144) at the next communi- 
cation. Optionally, after step 138, service provider 80 
can additionally implement the steps marked at point "A" 
illustrated in FIG. 9 to the conclusion of that flow chart. 
These additional steps, as shown by FIG. 9, compare 
the newly digitized and transferred high resolution im- 
age files with the content identifiers for the automatic 
routing of and adding information to form image media 
files based on identified content within the high resolu- 
tion image files. 

[0037] The flow chart of FIG . 8 shows another method 
for sharing of the media collection wherein the user has 
provided information regarding the content of the files 
to be shared using software operable on user computer 
1 0. The information has been stored as metadata asso- 
ciated with the image file within the high resolution im- 
age media collection on the user computer 1 0 or storage 
drive 14. In step 148, a connection is automatically es- 
tablished between service provider 80 and the user 
computer 1 0. Optional step 1 49 reflects system 200 per- 
mitting the user to turn "on" or "off' the feature of auto- 
matically routing an image media file to a third party. If 
the autoroute feature is turned off, the rest of this flow 
chart doesn't apply ending the process in step 1 62. 
[0038] Continuing at step 1 50, service provider 80 de- 
termines if a new media file has been added to the high 
resolution image media collection on the user computer 
1 0. Upon finding new high resolution image media files, 
service provider 80 examines the metadata associated 
with the new high resolution image media file for specific 
sharing metadata at step 152. For example, a high res- 
olution image media file that is a still image of "John" 
has been annotated by the user as "John". In the user's 
supplied account information with service provider 80, 
"John" has been correlated to an electronic mail address 
as john.doe@service.com. Sharing this image media 
file (step 158) causes an electronic mail message to be 
generated and forwarded to john.doe@service.com. Al- 
ternatively, "John" also has an account and low resolu- 
tion image media collection with service provider 80. 
Sharing (step 1 58) in this alternative example, is accom- 
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plished by a direct file transfer from the low resolution 
image media collection of the user to the low resolution 
image media collection of "John". Intermediate steps 
154 and 156, allow service provider 80 to aggregate 
multiple image media files to be shared with the same 
third party. After sharing the image media files in accord- 
ance with the examined metadata, the new image media 
files within the high resolution image media collection 
are updated (step 160) with the metadata of which third 
party they were shared with. 

[0039] Turning now to FIG. 9, another method for the 
sharing of and adding non-image information to image 
media files is shown as a flow chart wherein system 200 
analyzes the content of the image media files and auto- 
matically shares those image media files with author- 
ized third parties in accordance with instructions stored 
at service provider BO in association with the user. Sys- 
tem 200 additionally stores information associated with 
recognized content as metadata with the image media 
files. Beginning with connecting to user computer 10 in 
step 166, system 200 checks the high resolution image 
media collection for new added files (step 168). If no 
new files have been added, the current process ends in 
step 184. Upon finding new files (step 168), the compu- 
ter system 86 of service provider 80 loads user content 
identifiers (step 170) from relational databases 88 as- 
sociated with the user. Continuing on with step 172, 
computer system 86 processes the newly added files 
against the user content identifiers in accordance with 
the aforementioned EPO patent application of John R. 
Squilla and Dale Fredrick Mclntyre, serial no. 
01202975.7, previously discussed. The processed high 
resolution image files with recognized content have 
metadata appended to them as determined by the con- 
tent identifiers. Steps 174, 176 and 178 iteratively ex- 
amine the processed image files for recognized content, 
add the information associated with the recognized con- 
tent as metadata and create a sharing image media file 
that can include a plurality of the processed image files 
to be shared with a single third party. The sharing file is 
sent to a third party identified by the associated content 
identifier in step 180 following which, the image files 
have "sent to" metadata stored in association with the 
specific image file (step 182) both in the low resolution 
image media collection stored at the service provider 80 
and the high resolution image media collection stored 
in the user computer 10 or storage device 14. 
[0040] FIG. 1 0 is a partial view of the display screen 
204 of user computer 10 wherein a representative im- 
age 206 of the high resolution image media file is dis- 
played. Dotted line "L" indicates selected image content 
identifier and results from an action taken by software 
running on the user computer 10 in response to a user 
acting with a selection device such as a computer 
mouse or in response to an algorithm for identifying con- 
tent. The selected image content identifier forms the im- 
age icon 202 as shown by FIG. 10b which is a form of 
content identifier. 



[0041] Turning now to FIG. 11, there is illustrated a 
flow chart for operating another aspect of system 1 8 and 
modified system 200. Beginning in step 250, service 
provider 80 establishes a connection with third party 

5 computer 16 over communication network 50 for the 
purposes of transferring low resolution image media 
files sent to the third party by the user. After establishing 
a working. connection, service provider 80 downloads 
the low resolution image media files to third party com- 

10 puter 1 6 (step 252) which detects the newly shared low 
resolution image media files, (step 254) and launches a 
low resolution image media file browser such as stand- 
ard slide show software (step 256) thus eliminating the 
need to detach an image media file from an e-mail mes- 

15 sage and launch an image viewing application. 

[0042] Turning now to FIG. 12, a flow chart illustrates 
the process of tracking an individual low resolution im- 
age media file associated with a user when it is used by 
an authorized third party for producing image based 

20 goods and/or services and awarding loyalty points to the 
user. Beginning with step 228, an authorized third party 
places an order for image based goods and/or services 
with service provider 80 based on a low resolution image 
media file shared by the user. The authorized third party 

25 also provides a form of electronic payment such as a 
credit card to service provider 80 in a manner well un- 
derstood in the art for electronic commerce transac- 
tions. Service provider 80 needs the high resolution im- 
age media file to forward to fulfillment provider 70. In 

30 step 230, service provider 80 determines the user who 
shared the low resolution image media file that the third 
party is using to place an image based order. This can 
be accomplished by looking at the metadata associated 
with the low resolution image media file as discussed 

35 earlier. 

[0043] Continuing with step 232, the service provider 
80 determines if the user computer 1 0 associated with 
the low resolution image media file is connected to the 
communication network 50. If user computer 10 is not 

40 available, the service provider 80 places a request (step 
242) for the associated high resolution image media file 
with the account manager 84 for retrieval at the next rou- 
tine communication interval indicated by the dotted line 
"M". Optionally, service provider 80 can send an e-mail 

45 message to the user to alert him/her that a high resolu- 
tion image media file is required to fulfill an order. In yet 
another method of notification, service provider 80 can 
send an automated phone message to the user instruct- 
ing him/her to make user computer 10 available. When 

50 the user computer 1 0 is operably connected to the com- 
munication network 50, the associated high resolution 
image media file is retrieved and forwarded to the fulfill- 
ment provider 70 in step 234. The user's account is then 
updated with loyalty points (step 236) assigned as a re- 

55 suit of the transaction of the third party. The loyalty 
points can be assigned as a function of a dynamic look- 
up table managed by service provider 80. For example, 
a 4x6 hard copy print might earn 10 loyalty points, an 
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album page 100 points and a Compact Disc (CD) 200 
points and so on and so forth for other goods and/or 
services that can be offered by service provider 80 or 
fulfillment provider 70. The loyalty points can be dynam- 
ically adjusted by the service provider 80 in response to 
market conditions or levels of user orders. Similarly, new 
products might be offered with a temporary higher level 
of loyalty points to encourage their trial and use. 
[0044] Fulfillment provider 70 completes the order 
placed by the third party and delivers the image based 
goods and/or services in step 238. If the third party has 
a similar arrangement for a low resolution image media 
file collection with service provider 80, account manager 
84 assigns loyalty points (step 240) to the account of the 
third party based on this order. At the completion of the 
order, service provider 80 distributes revenues (step 
244) collected from the third party to those providers as- 
sociated with the developing, scanning, processing, 
printing etc. where such providers have contributed to 
the production of the ordered goods and/or services. An 20 
example of revenue distribution amongst various con- 
tributing providers is illustrated in the table of FIG 13. If 
the service provider 80 also completes the fulfillment of 
the ordered goods, then the service provider 80 earns 
the designated percentage "D" that would normally have 25 
been distributed to fulfillment provider 70. A retail store, 
for example, could process, print and scan negatives 
earning the combined designated percentages of "B M 
and "C" of the revenue collected by service provider 80. 
It is of course to be understood that the amount of per- 30 
centages can be any desired value. 
[0045] Turning now to FIG. 14, there is illustrated a 
process for restoring data structure information for high 
resolution image files stored on storage device 1 4 in the 
event of a user device malfunction. Beginning in step 35 
260, the user has received a disk read error while trying 
to view or otherwise use an image from the high reso- 
lution image media collection stored on storage device 
14. Setting a disk drive service flag (step 262), the user 
is asked (step 264) by software running on the user com- 40 
puter 10, if they desire to back up the high resolution 
image collection onto removable storage media prior to 
servicing the malf unctioning disk drive. The user option- 
ally can choose (step 266) to back up the high resolution 
image media collection at home onto a storage device 45 
operably connected to user computer 10 or via service 
provider 80 uploading all of the high resolution image 
files that weren't previously backed up. In step 272, the 
user has chosen to back up the high resolution image 
media files at home whereby software running on user 50 
computer 1 0 causes the appropriate high resolution im- 
age media files to be written to removable storage media 
supplied by the user. If backing up the high resolution 
image media files at home is not possible, then the user 
can request service provider 80 to perform this task in 55 
exchange for a service fee. At a convenient time, service 
provider 80 uploads (step 268) all the high resolution 
image media files not previously backed up. Continuing 



with step 270, service provider 80 writes the uploaded 
high resolution image media files to an appropriate re- 
movable media which was previously agreed to by the 
user. After completing the writing and verifying of high 
resolution image media files, service provider 80 causes 
the written removable media to be sent to the user and 
deletes (step 270) the uploaded high resolution image 
media files. Of course, the user can choose to pay an 
additional fee and keep all the high resolution image me- 
dia files stored at service provider 80. Following the 
completion of backing up high resolution image media 
files, service provider 80 downloads (step 274) data 
storage parameters to the user computer 10 which are 
updated at each communication or on a periodic basis. 
Finally in step 276, software running on the user com- 
puter 10 uses the data storage parameters to restore 
the integrity of the storage device 14. 
[0046] Turning now to FIG. 15, there is illustrated an- 
other modified system 300 made in accordance with the 
present invention. System 300 is similar to system 18 
with like numerals indicating like parts and operation as 
previously discussed. In system 300, user computer 1 0 
permits the storage of high resolution image media files 
provided from a number of image media file sources on 
storage device 14. High resolution image media files 
can be provided by photofinisher 90, as previously dis- 
cussed, which provides high resolution image media 
files associated with the user to service provider 80 for 
eventual transferring to the user computer 1 0. There are 
many other ways in which image media files associated 
with the user can be provided to service provider 80 for 
transferto the user computer 1 0. For example, high res- 
olution image media files captured by a cellular wireless 
electronic (digital) camera 23 can be transferred to serv- 
ice provider 80 through a common telecommunications 
network 25. Each transfer through the telecommunica- 
tions network 25 can generate a transfer fee to be 
charged to the user through service provider 80. Fur- 
thermore, service provider 80 can process the high res- 
olution image media file from the cellular wireless elec- 
tronic camera 23 with respect to content identifiers as- 
sociated with the user as previously discussed with re- 
spect to FIGS. 1, 10a and 10b. Upon matching image 
content of the transmitted high resolution media file with 
the users content identifiers, service provider 80 can 
send a return message to the cellular wireless camera 
23 prompting the user to verify the content identified by 
service provider 80. The verification prompt message 
can be displayed on the color LCD image display 332 
and the user operating push buttons 372-376 shown in 
FIG. 1 9 can respond to validate or invalidate the identi- 
fied content. Such validation is advantageous while the 
user has just captured the image and his memory of the 
image content is still fresh. 

[0047] Another example in which image media files 
associated with the user can be provided to service pro- 
vider 80 for transfer to the user computer 10 is a kiosk 
15 such as the Kodak Picture Maker™ kiosk that in- 
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eludes a scanner for producing a high resolution image 
media file of a hardcopy print. Connected to the com- 
munications network 50, the kiosk 1 5 can, for a fee, pro- 
vide high resolution image media files to service provid- 
er 80 that are eventually transferred to the user compu- 
ter 10. 

[0048] In FIG. 1 6, a process for operating the systems 
1 8, 200 and 300 is shown which permits the user to re- 
quest an extended service in association with a partic- 
ular high resolution image media file. Beginning in step 
280, the user electronically tags (identifies) a high res- 
olution image media file with an extended service indi- 
cia. The extended service indicia causes software run- 
ning on the user computer 10 to retrieve an electronic 
form (See FIG. 1 7) that is associated with the requested 
extended service. The electronic form can be stored on 
the user computer 10 as part of a service agreement 
with service provider 80 or it can be actively retrieved 
from the service provider 80. In either case, the elec- 
tronic form is retrieved and filled out (step 282) by the 
user. Upon establishing communication (step 284) ei- 
ther immediately or at the routine communication inter- 
val, service provider 80 determines (step 286) if any ex- 
tended services have been requested. If not, service 
provider 80 completes the typical processing done at the 
routine communication interval (step 288) as has been 
previously discussed ending the process in step 294. If 
extended services have been requested, service pro- 
N - vider 80 uploads (step 290) the completed electronic 
form associated with the high resolution image media 
file. Following this step, service provider 80 executes 
(step 292) the extended service request as indicated by 
the instructions on the electronic form shown in FIG. 17, 
with the process ending in step 294. 
[0049] Turning now to FIG. 17, a screen shot 310 of 
user computer 1 0 is shown that includes a visual repre- 
sentation 316 of a high resolution image media file to 
which an extended service request form is attached. An 
instruction block 312, contains information for the serv- 
ice provider 80 to follow in the execution of the request- 
ed extended service. In this example, the user has indi- 
cated that the high resolution image media file is to be 
placed for sale which can be one type of extended serv- 
ice offered by service provider 80. The italicized word 
"BOAT" can be the result of the user selecting a word 
from a list or it can be the result of applying the user's 
content identifiers to this specific high resolution image 
media file. Information block 314 includes keywords that 
can be input by the user and useful in the execution of 
the requested extended service. Other extended serv- 
ices include posting the visual representation 31 6 of the 
high resolution image media file to a website that uses 
such visual representations 316 to aid in the selling of 
goods or to aid in the finding of a seller of such goods. 
[0050] Another example of an extended service is the 
use of the high resolution image media file to represent 
an item insured by a third party such as an insurance 
business. In the event that an insurance business has 



been contracted with by the user to insure specific 
household belongings, high resolution image media 
files help the user get insurance rates that reflect the 
actual belongings depicted in the high resolution image 

5 media file. The user provides specific information about 
the specific household belonging depicted by the high 
resolution image media file such as manufacturer, pur- 
chase price, purchase date, serial number and any other 
information necessary to providing insurance on such a 

10 belonging. Additionally, the user provides authorization 
to service provider 80 for the third party insurance busi- 
ness to view specific high resolution image media files. 
Tagging a high resolution image media file for adding to 
an insured item list or deleting from an insured item list 

15 permits an automatic update of insurance coverage and 
can result in an added fee or credit applied to the user 
by the third party insurance business. Service provider 
80 can charge a fee from a third party business for per- 
mitting the third party business such as an insurance 

20 business to view image media files depicting household 
objects belonging to the user. An additional third party, 
such as the retailer of the item sold, can be used for 
validation of ownership and sale of the particular item. 
[0051] Another example of extended services in- 

25 eludes a service performed by a non-professional third 
party user or peer (a free lance individual) operable in 
the systems 18, 200 and 300 by the processes shown 
in FIGS. 16 and 18. The process of FIG. 18 describes 
an example of a detailed process used by service pro- 

30 vider 80 in step 292 of FIG. 16. In this case, the user 
has provided unlimited third party authorized access to 
a high resolution image media file or group of high res- 
olution image media files on the extended service re- 
quest form for the purposes of restoring a scanned high 

35 resolution image file created from an older, damaged 
hardcopy print. Information on the extended service re- 
quest form can include an amount of money that re- 
questing user is willing to pay in exchange for the serv- 
ice. In lieu of money, account manager 84 can provide 

40 account credits to the third party providing the service. 
These account credits can be used when the third party 
requests extended services from other users. Account 
manager 84 can also provide account credits in the form 
of loyalty points or reduced account fees. 

45 [0052] Beginning with step 550, service provider 80 
retrieves the high resolution image media file from the 
user computer 10 and stores the high resolution image 
media file in a memory of computer system 86. While 
this is the preferred embodiment, the retrieval of the high 

50 resolution image media file from user computer 10 need 
not happen until after third party user accepts the serv- 
ice request in step 558. Following in step 552, service 
provider 80 adds the extended service request form in- 
cluding a low resolution image file to a list of service re- 

55 quests on a web page whose access and display is man- 
aged by web server 82 and account manager 84. Third 
party users access (step 554) the list of extended serv- 
ice request and decide to accept or not accept an ex- 
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tended service request in step 556. Third party users 
can counter offer (step 566) to perform the extended 
service for terms differing from what was originally of- 
fered. For example, the third party user can raise the 
required amount of money from that originally offered to 
complete the service. The user requesting the service 
can choose to accept (step 568) the revised terms of 
service or end the negotiation in step 570. If terms 
agreed upon, the third party user retrieves (step 558) 
the high resolution image file to perform the service on 
from either service provider 80 or directly from the re- 
questing user by accessing the high resolution image 
media file on user computer 10. 

[0053] The third party user performs (step 560) the ex- 
tended service requested, which in this example is an 
image restoration, by using commonly available tools 
such as Photoshop™ produced by Adobe Systems Inc. 
The third party modified high resolution image media file 
is converted to a low resolution image file for review by 
the user requesting the extended service. If the user re- 
questing the extended service accepts (step 562) the 
work of the third party user, service provider 80 assigns 
(step 564) credits to the third party user less a fee for 
brokering the service and debits to the user requesting 
the extended service with the process ending in step 
570. Cataloging images is another extended service 
that can be provided by third party users or peers in this 
manner. 

[0054] Turning now to FIG. 1 9, a block diagram of an 
electronic (digital) camera 23 which captures high res- 
olution image files that are stored on the removable 
memory card 350. FIG. 20 depicts a rear view of the 
electronic camera 23 of FIG. 1 9. The electronic camera 
23 is powered by rechargeable batteries 344 that con- 
nect to power supply 346 which supplies power to the 
camera circuits depicted in FIG. 1 9. A charger input 348 
is provided as an external connection (which can be in- 
cluded as part of interface connection 342) so that the 
rechargeable batteries 344 can be recharged by an ex- 
ternal power source. The electronic camera 23 includes 
a zoom lens 352 having zoom and focus motor drives 
360 and an adjustable aperture and shutter (not shown). 
The user composes the image using the optical view- 
finder 341 and the zoom lens control 334 and then de- 
presses the shutter button 331 to begin capture of a still 
image. The zoom lens 352 focuses light from a scene 
(not shown) on an image sensor 354, for example, a sin- 
gle-chip color CCD image sensor, using the well-known 
Bayer color filter pattern. The image sensor 354 is con- 
trolled by clock drivers 366. The zoom and focus motors 
360 and the clock drivers 366 are controlled by control 
signals supplied by a control processor and timing gen- 
erator circuit 364. The control processor and timing gen- 
erator circuit 364 receives inputs from autofocus and au- 
to-exposure detectors 368 and controls a flash 362. The 
analog output signal from the image sensor 354 is am- 
plified and converted to digital data by the analog signal 
processing (ASP) and analog-to-digital (A/D) converter 



circuit 356. The digital data is stored in a Dynamic Ran- 
dom Access Memory (DRAM) buffer memory 358 and 
subsequently processed by a processor 320 controlled 
by the firmware stored in the firmware memory 328, 
5 which can be flash Erasable Programmable Read Only 
Memory (EPROM). 

[0055] The processed high resolution image file is 
provided to a memory card interface 324 which stores 
the high resolution image file on the removable memory 

10 card 350. Removable memory cards 350 are one type 
of removable image digital storage medium and are 
available in several different physical formats. For ex- 
ample, the removable memory card 350 can include 
memory cards adapted to the Personal Computer Mem- 

15 ory Card International Association (PCMCIA) card inter- 
face standard, as described in the PC Card Standard, 
Release 2.0, published by the Personal Computer Mem- 
ory Card International Association, Sunnyvale, Califor- 
nia, September 1 991 . The removable memory card 350 

20 can also be adapted to the Compact Flash interface 
standard, such as described in the CompactFlash Spec- 
ification Version 1.3, published by the CompactFlash 
Association, Palo Alto, California, August 5, 1998, orto 
the well-known SmartMedia, MemoryStick or SD mem- 

25 ory card formats . Other types of removable image digital 
storage media, such as magnetic hard drives, magnetic 
tape, or optical disks, can alternatively be used to store 
the digital images. 

[0056] The processor 320 performs color interpola- 
te tion followed by color and tone correction, in order to 
produce rendered sRGB image data. The rendered 
sRGB image data is then JPEG compressed and stored 
as a JPEG image file on the removable memory card 
350. The JPEG file uses the so-called "Exif" image for- 
mat defined in "Digital Still Camera Image File Format 
(Exif)" version 2.1, July 1998 by the Japan Electronics 
Industries Development Association (J El DA), Tokyo, 
Japan. This format includes an Exif application segment 
that stores particular image metadata, for example the 
date and time the picture was captured, the lens f/ 
number and other camera settings and image captions 
or comments that can be selected or entered by the 
camera user. 

[0057] The electronic camera 23 also includes a mo- 
dem 390 connected to an RF antenna 392. The modem 
390 is preferably a cellular modem using, for example 
CDMA (Code Division Multiple Access) orTDMA (Time 
Division Multiple Access) technologies. The modem 390 
communicates with communication network 50 via a 
wide area cellular network, such as the 1900 MHz CD- 
MA network deployed by Sprint PCS in the USA. 
[0058] An interface connection 342 can be used to 
connect between an interface 322 in the electronic cam- 
era 23 and a corresponding camera interface in the user 
computer 10. The interface connection 342 may con- 
form to, for example, the well-known universal serial bus 
(USB) interface specification, orto many other standard 
interfaces. The interface connection 342 can be used to 



40 



45 



50 



12 



23 



EP 1 280 329 A2 



24 



transfer images from removable memory card 350 to the 
user computer 1 0. The interface connection 342 can al- 
so be used to transfer data from the user computer 10 
to firmware memory 328 in electronic camera 23. In par- 
ticular, it can optionally be used to transfer phone num- 
bers, e-mail addresses, internet URLs, etc. to firmware 
memory 328. 

[0059] The graphical user interface displayed on the 
color LCD image display 332 is controlled by mode con- 
trol 370 and push buttons 372-376 shown in FIG. 19. 
The user places the mode control 370 in the "capture" 
position prior to capturing images. The user places the 
mode control 370 in the "review" position in order to re- 
view the captured images, delete undesirable images 
and transfer images via modem 390, using push buttons 
372-376. An optional microphone 394, connected con- 
trol processor and timing generator circuit 364 via audio 
codec 396, can be used to receive voice commands, as 
described in described in commonly-assigned U.S. Pat- 
ent 5,737,491 entitled "ELECTRONIC IMAGING SYS- 
TEM CAPABLE OF IMAGE CAPTURE, LOCAL WIRE- 
LESS TRANSMISSION AND VOICE RECOGNITION" 
to Allen, et. al., the disclosure of which is herein incor- 
porated by reference. 

[0060] FIG. 21 depicts a flow chart of a method of us- 
ing the electronic camera 23 in order to transfer high 
resolution image files captured by the electronic camera 
23 to a user's high resolution image collection, automat- 
ically e-mail images to one or more people depicted in 
the captured images and order copies of high resolution 
image files from fulfillment provider 70. In step 400, the 
user registers their electronic camera 23 with the service 
provider 80 and provides information such as was de- 
scribed earlier in relation to step 30 of FIG. 2. In step 
402, the service provider 80 provides a service ID and 
network configuration information which is stored in the 
firmware memory 328 of electronic camera 23. This can 
be done when the electronic camera 23 is purchased or 
rented from the service provider 80. This enables the 
electronic camera 23 to automatically connect to the 
communications network 50 via modem 390 in order to 
transfer high resolution image files and control informa- 
tion to the service provider 80. 

[0061] In step 404, the user content identifiers de- 
scribed earlier in relation to FIGS. 9-1 0 are stored in the 
firmware memory 328 of electronic camera 23. This en- 
ables the electronic camera 23 to recognize user con- 
tent present in any captured high resolution image files. 
In step 406, the user fulfillment preferences are stored 
in firmware memory 328 of electronic camera 23. These 
preferences may stored using a service account infor- 
mation file as described in commonly-assigned EPO 
Patent application Serial no. 01201711.7 filed May 10, 
2001 to Parulski, the disclosure of which is herein incor- 
porated by reference. This service account information 
file can be created when the user purchases or rents the 
electronic camera 23, in response to user selections of 
preferred photo products, such as service prints, album 



pages and the like, that the user is likely to purchase 
from the fulfillment provider 70. 

[0062] Following step 406, the electronic camera 23 
is ready to capture high resolution images. In step 408, 
5 the user captures a group of high resolution images us- 
ing the electronic camera 23. The high resolution imag- 
es are processed as described earlier and temporarily 
stored on memory card 350. In step 410, the captured 
high resolution images are optionally examined to de- 
termine if one or more are recognized as including user 
content, using the user content identifiers provided in 
step 404. Each user content identifier includes at least 
one e-mail address. In step 412, for each image which 
has been recognized as having user content (e.g. each 
image including the face of the person corresponding to 
image icon 202 in FIG. 10) the images are marked for 
automatic transfer to the e-mail address(s) correspond- 
ing to the recognized image icon 202. This image mark- 
ing can be implemented, for example, by creating a Dig- 
ital Print Order Format (DPOF) version 1 .1 "auto trans- 
fer" file which includes the e-mail address and the file 
names of the images which have been recognized as 
including the image icon 202. This auto transfer file is 
preferably an ASCII text file named AUTXFER.MRK, in 
accordance with the DPOF specification. 
[0063] In step 414, the user optionally reviews the 
captured high resolution images and orders photo prod- 
ucts, such as enlargements and album pages, using the 
captured high resolution image files. The switches 
372-376 are used to select high resolution image files 
to be printed to produce these photo products and the 
number of copies to be made. In step 41 6, the electronic 
camera 23 creates an image utilization file. This image 
utilization file is preferably an ASCII text file named AU- 
TOPRNTMRK, in accordance with the Digital Print Or- 
der Format (DPOF) specification. 
[0064] In step 41 8, the captured high resolution image 
files and the optional DPOF auto transfer and print order 
files are transmitted to the service provider 80 via mo- 
dem 390 and are temporarily stored at the service pro- 
vider 80. The transmission begins when the electronic 
camera 23 provides an ID that identifies the user ac- 
count and the instructions provided by the user during 
the registration process. These instructions normally in- 
clude the address of the user's high resolution collec- 
tion. The instructions can also include default photo 
product requests, that can be used instead of, or in ad- 
dition to, the DPOF print order file. For example, the in- 
structions can specify that one 4x6 inch print (10.16cm 
x 1 5.24cm) of each uploaded image should be produced 
and mailed to a user specified address. In this case, the 
DPOF print order file is used only when the user wishes 
to override this "default" instruction. 
[0065] In step 420, low resolution copies of each up- 
loaded high resolution image file are added to the low 
resolution image collection associated with the ID pro- 
vided by the electronic camera 23. These low resolution 
copies are normally stored at the service provider 80 so 
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that they can be accessed by authorized third parties as 
described earlier in reiation to step 44 of FIG. 1 . 
[0066] In step 422, the high resolution image files are 
transferred from the service provider 80 to the user's 
high resolution image collection (normally located on the 
user computer 10) as described earlier in step 120 of 
FIG. 6. This transfer can occur during the next routine 
communication interval, or during a non-scheduled 
communication. 

[0067] In step 424, the high resolution image files are 
e-mailed to the e-mail addresses provided in the DPOF 
AUTXFER.MRK file described earlier in relation to step 
412. 

[0068] In step 426, the high resolution image files are 
transferred from the service provider 80 to the fulfillment 
provider 70, where they are used to produce the default 
photo products defined in the instructions provided by 
the user in step 400, or in the DPOF AUTPRINT.MRK 
file described earlier in relation to step 416. 
[0069] After the high resolution image files have been 
transferred, they no longer need to be stored by the 
service provider 80. Alternatively, service provider 80 
can store the high resolution image files for a fixed pe- 
riod of time such as 90 days to facilitate product reor- 
dering. After such a fixed period, the high resolution im- 
age files are converted to low resolution image files and 
added to the user's low resolution collection as previ- 
ously discussed. 

[0070] Turning now to FIG. 22, there is shown a flow 
chart which shows another method of operation of the 
system of FIG. 1 . In this embodiment, the low resolution 
images are maintained on user computer 10, ratherthan 
being provided by the service provider 80. In step 500, 
the user establishes an account with the service provid- 
er 80 and establishes account data flow parameters, as 
described earlier in reference to step 30 of FIG. 2. In 
step 502, the user identifies an image collection, as de- 
scribed earlier in reference to step 32 of FIG. 2. 
[0071] In step 504, a low resolution image database 
is created on the user computer 10, so that low resolu- 
tion images can be provided to authorized third parties. 
In step 506, an on-line connection is established using 
CSP 20 and communication network 50, between the 
user's home computer 10 and the service provider 80, 
to indicate that the user is now on-line. In step 508, the 
service provider 80 determines which, if any, authorized 
third parties are currently on-line and wish to view the 
images in the low resolution image collection of the user. 
In step 510, the low resolution images are transferred 
from the user computer 10 to the computer 16 of the 
authorized third party using CSP 20, communication 
network 50 and CSP 22. In step 512, the third party 
views the low resolution images transferred from the us- 
er computer 10 on the third party computer 16. In step 
514, the third party requests the high resolution version 
of one or more low resolution images transferred from 
the user computer 10. In step 516, the high resolution 
images are transferred from the user computer 1 0 to the 



third party computer 1 6. 

[0072] Turning now to FIG. 23, there is shown a flow 
chart which shows another method of operation of the 
system 18 of FIG. 1 or the system 200 of FIG. 5. Instep 
5 520, an authorized third party views the low resolution 
images of a first user. These low resolution images may 
be provided by the service provider 80, as described in 
relation to FIG. 2 and FIG. 6, or may be provided from 
the first user computer 10, as described in relation to 
10 FIG. 21 . In step 522, the authorized third party selects 
one or more low resolution images from the first user's 
collection, for inclusion in a photo product, such as a 
photo album or a photo montage, containing numerous 
pictures. Such pictures might, for example, be of the 
15 same event attended by the first user, a second user 
and an authorized third party. 

[0073] In step 524, the authorized third party views 
the low resolution images of the second user. Again, 
these low resolution images may be provided by the 
20 service provider 80, as described in relation to FIG. 2 
and FIG. 6, or may be provided from the second user's 
computer, as described in relation to FIG. 21. In step 
526, the authorized third party selects one or more low 
resolution images from the second user's collection, for 
25 inclusion in the same photo product. 

[0074] In step 527, the authorized third party places 
an order with the fulfillment provider 70, via service pro- 
vider 80, for the photo product, which includes the se- 
lected images from the first user's collection and the 
30 second user's collection. In step 528, high resolution 
versions of the images selected by the authorized third 
party are transferred from the first user's high resolution 
collection to the fulfillment provider 70. This may occur 
immediately if the first user is currently on-line, or at a 
35 later time at the next routine communication interval. In 
step 530, high resolution versions of the images select- 
ed by the authorized third party are transferred from the 
second user's high resolution collection to the fulfillment 
provider 70. In step 532, the fulfillment provider 70 pro- 
40 duces and ships the photo product selected by the au- 

thori^oH thirrl r»or+%# ~J : _ _i ... . . 

„ ^„, LJf lw UIC ucoiyiieueu augress provided 

by the authorized third party and bills the authorized 
third party for the photo product. In step 534, loyalty 
points are assigned to the first and second users, for 
45 providing the digital images which were used in the pho- 
to product. 
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An electronic camera for capturing of digital images, 
said camera comprising: 

a communication device for wireless transmis- 
sion of digital image files captured by said elec- 
tronic camera to a recipient: 

a selection device for creating an electronic 
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content identifier to be associated with a 
digital image file in said camera, said cam- 
era having a cell modem for sending imag- 
es up to a service provider, said content 
identifier identifying a recipient that said as- 5 
sociated digital image file is to be forward- 
ed. 

2. An electronic camera according to claim 1 wherein 
said icon is automatically generated in response to 10 
analyzing said digital image file and determining 
that a predetermined image content is present. 



3. An electronic camera according to claim 2 wherein 
said predetermined image content comprises face 
recognition of an individual. 

4. An electronic camera forcapturing of digital images, 
said camera comprising: 

a communication device for wireless transmis- 
sion of digital image files captured by said elec- 
tronic camera to a recipient; 

a computer software program for analyzing 
said digital image files for recognizing a 
pre-selected image content, upon recog- 
nizing said image content an electronic in- 
struction is created with respect to further 
processing of said digital image by said re- 
cipient which is transmitted to said recipi- 
ent along with digital image file. 

5. An electronic camera according to claim 4 wherein 
said instruction comprises an icon which identifies 
a specific instruction that is known to said recipient. 

6. An electronic camera according to claim 4 wherein 
said recipient is a service provider. 

7. A system for transmitting digital image files cap- 
tured by an electronic camera for capturing of digital 
images , said camera having a communication de- 
vice for wireless transmission of digital image files 
captured by said electronic camera to a recipient; 

said recipient having a computer software 
program for analyzing said digital image files for 
recognizing a pre-selected image content, upon 
recognizing said image content an electronic in- 
struction is created with respect to further process- 
ing of said digital image by said recipient. 

8. A system according to claim 7 wherein said digital 
image file is automatically transmitted to a third a 
party. 

9. A method for managing image transmitted directly 
from an electronic camera to recipient, said elec- 



tronic camera having a device for wireless transmis- 
sion of a digital media file to said recipient, compris- 
ing the steps of: 

receiving a digital media file over a wireless 
transmission from said electronic camera, said 
digital medial file having a digital image file and 
an instruction with respect to said digital image 
file; 

implementing said instructions provided in said 
digital media file. 

1 0. A method according to claim 9 wherein said instruc- 
tion includes the step of: 

15 

said recipient analyzing said digital image file 
for a predetermined image content identifier. 
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